Monitoring Multiple U.S. Government-Supported Covid-19 Vaccine Trials

Operation Warp Speed was a partnership created to accelerate the development of Covid-19 vaccines. The National Institutes of Health oversaw one data and safety monitoring board to review/monitor all Operation Warp Speed trials. This article describes the challenges faced in monitoring these trials and provides ideas for future similar endeavors.

A platform trial design for preventive vaccines against Marburg virus and other emerging infectious disease threats.

BACKGROUND: The threat of a possible Marburg virus disease outbreak in Central and Western Africa is growing. While no Marburg virus vaccines are currently available for use, several candidates are in the pipeline. Building on knowledge and experiences in the designs of vaccine efficacy trials against other pathogens, including SARS-CoV-2, we develop designs of randomized Phase 3 vaccine efficacy trials for Marburg virus vaccines. METHODS: A core protocol approach will be used, allowing multiple vaccine candidates to be tested against controls. The primary objective of the trial will be to evaluate the effect of each vaccine on the rate of virologically confirmed Marburg virus disease, although Marburg infection assessed via seroconversion could be the primary objective in some cases. The overall trial design will be a mixture of individually and cluster-randomized designs, with individual randomization done whenever possible. Clusters will consist of either contacts and contacts of contacts of index cases, that is, ring vaccination, or other transmission units. RESULTS: The primary efficacy endpoint will be analysed as a time-to-event outcome. A vaccine will be considered successful if its estimated efficacy is greater than 50% and has sufficient precision to rule out that true efficacy is less than 30%. This will require approximately 150 total endpoints, that is, cases of confirmed Marburg virus disease, per vaccine/comparator combination. Interim analyses will be conducted after 50 and after 100 events. Statistical analysis of the trial will be blended across the different types of designs. Under the assumption of a 6-month attack rate of 1% of the participants in the placebo arm for both the individually and cluster-randomized populations, the most likely sample size is about 20,000 participants per arm. CONCLUSION: This event-driven design takes into the account the potentially sporadic spread of Marburg virus. The proposed trial design may be applicable for other pathogens against which effective vaccines are not yet available.

Determinants of hospital outcomes for patients with COVID-19 in the University of Pennsylvania Health System.

There is growing evidence that racial and ethnic minorities bear a disproportionate burden from COVID-19. Temporal changes in the pandemic epidemiology and diversity in the clinical course require careful study to identify determinants of poor outcomes. We analyzed 6255 hospitalized individuals with PCR-confirmed SARS-CoV-2 infection from one of 5 hospitals in the University of Pennsylvania Health System between March 2020 and March 2021, using electronic health records to assess risk factors and outcomes through 8 weeks post-admission. Discharge, readmission and mortality outcomes were analyzed in a multi-state model with multivariable Cox models for each transition. Mortality varied markedly over time, with cumulative incidence (95% CI) 30 days post-admission of 19.1% (16.9, 21.3) in March-April 2020, 5.7% (4.2, 7.5) in July-October 2020 and 10.5% (9.1,12.0) in January-March 2021; 26% of deaths occurred after discharge. Average age (SD) at admission varied from 62.7 (17.6) to 54.8 (19.9) to 60.5 (18.1); mechanical ventilation use declined from 21.3% to 9-11%. Compared to Caucasian, Black race was associated with more severe disease at admission, higher rates of co-morbidities and residing in a low-income zip code. Between-race risk differences in mortality risk diminished in multivariable models; while admitting hospital, increasing age, admission early in the pandemic, and severe disease and low blood pressure at admission were associated with increased mortality hazard. Hispanic ethnicity was associated with fewer baseline co-morbidities and lower mortality hazard (0.57, 95% CI: 0.37, .087). Multi-state modeling allows for a unified framework to analyze multiple outcomes throughout the disease course. Morbidity and mortality for hospitalized COVID-19 patients varied over time but post-discharge mortality remained non-trivial. Black race was associated with more risk factors for morbidity and with treatment at hospitals with lower mortality. Multivariable models suggest there are not between-race differences in outcomes. Future work is needed to better understand the identified between-hospital differences in mortality.

Data and Safety Monitoring of COVID-19 Vaccine Clinical Trials.

To speed the development of vaccines against SARS-CoV-2, the United States Federal Government has funded multiple phase 3 trials of candidate vaccines. A single 11-member data and safety monitoring board (DSMB) monitors all government-funded trials to ensure coordinated oversight, promote harmonized designs, and allow shared insights related to safety across trials. DSMB reviews encompass 3 domains: (1) the conduct of trials, including overall and subgroup accrual and data quality and completeness; (2) safety, including individual events of concern and comparisons by randomized group; and (3) interim analyses of efficacy when event-driven milestones are met. Challenges have included the scale and pace of the trials, the frequency of safety events related to the combined enrollment of over 100 000 participants, many of whom are older adults or have comorbid conditions that place them at independent risk of serious health events, and the politicized environment in which the trials have taken place.

AIDS and COVID: A tale of two pandemics and the role of statisticians.

The world has experienced three global pandemics over the last half-century: HIV/AIDS, H1N1, and COVID-19. HIV/AIDS and COVID-19 are still with us and have wrought extensive havoc worldwide. There are many differences between these two infections and their global impacts, but one thing they have in common is the mobilization of scientific resources to both understand the infection and develop ways to combat it. As was the case with HIV, statisticians have been in the forefront of scientists working to understand transmission dynamics and the natural history of infection, determine prognostic factors for severe disease, and develop optimal study designs to assess therapeutics and vaccines.

Clinical trials in the time of a pandemic.

The first rumblings about a new coronavirus spreading in China were heard in January 2020. By the end of that month, the World Health Organization, recognizing the severity of the disease and the potential for global spread, had declared a public health emergency. By February 2020, cases had been identified in multiple countries, clinical trials of treatments with some biological plausibility had begun in China, and the initial steps of vaccine development were underway. In mid-March, by which time countries around the world were experiencing rapidly increasing numbers of cases and deaths, the World Health Organization categorized the outbreak as a pandemic. This new coronavirus was designated SARS-COV-2 in recognition of its similarity to the coronavirus responsible for the severe acute respiratory syndrome outbreak in 2002-2003. The race is on to develop treatments that can mitigate the severe consequences of infection and vaccines that can prevent infection and/or diminish the severity of disease in those who do get infected. Many challenges face these development efforts. Some are similar to those faced in the past; others are new. The urgency of finding ways to treat, and ultimately prevent, the consequences of this new and potentially deadly infection has led to unprecedented focus on clinical trials.